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Background 

This invention relates to computer generation of 
documents using layout elements and content elements. 
Background 

Computer generated human -readable documents, for 



example, exhibit a wide range of forms including those 
appearing on paper or other "tangible" media and others that 
are only temporarily displayed on "intangible" media like the 
display surfaces of computer monitors. 



printed high- volume books, magazines, and commercial 
literature to multiple-color laser-printed medium-volume 
items to one-of-a-kind black-and-white pages printed on 
personal computer printers. Intangible documents include web 
20 pages that are received by telecommunication from a central 
source, screen displays that are generated by software 
running on local networks or individual workstations, and 
digitally-generated video frames. 



2 5 words, numbers, pictures, animations, and video. The content 
is presented in a way that reflects layout features. Layout 
features can include the styles in which content is presented 
(e.g., font, size, shape, color) and the locations and 
arrangements of elements on pages of a document. 

30 When traditional printing was the predominant method 

for producing documents, a document tended to have a fixed 
content and layout. More recently, using computer software, 



15 



Tangible documents range from full -color press- 



Human -readable documents include content 



such as 



# 



it has become easier to create documents that share common 
content but different layouts (for example, a web page and a 
printed sales sheet that have identical texts) or a common 
layout but different content (different sales sheets that 
5 share a common appearance but pertain to different products 
in a product line) . 

A document that is created in software typically is 
stored in a file that captures the layout and content of the 
document. When the document is to be produced in a tangible 

10 or intangible form, a formatter uses the information 
contained in the document description file to generate the 
document in a format suitable for the target medium. 

Layout and content both have structure. With respect 
to layout, for example, a box containing an image may contain 

15 another image box. Or the layout may require that two text 
boxes appear side by side on the page. Text has structure 
that, for example, defines the order of letters or words, or 
the grouping of sentences in paragraphs. When the formatter 
generates a document from a document description file, it 

20 sometimes must resolve conflicts between structure associated 
with the content and structure associated with the layout. 

Early software tended to mingle content and layout 
features of a document in the document description file. For 
example, the text content could be interspersed with escape 

25 codes that shifted fonts or redefined the locations of 
characters . 

In more recent software products, the document 
description files provide a sharper separation between 
content and layout features. This separation enables a user 
30 to make changes to layout without affecting the content 
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(e.g., to change all uses of Times-Bold font in a document to 
Helvetica-Bold) or to work with the content without changing 
the layout (e.g., to search the text for a particular 
string) . These recent software products are either content - 
5 centric or layout -concentric . 

Content -centric software, such as Microsoft Word, 
emphasizes content in the description files and supplements 
the content with layout features as needed. The user creates 
and manipulates text largely independently of the layout. 

10 Layout features are added to the text either manually by the 
user or automatically by the program. 

Layout -centric software, such as Adobe's PageMaker7, 
emphasizes layout features, such as placement of content 
elements on a page, in the document description files. The 

15 user creates and manipulates layout elements. Content is 
added to the layout -structured document as needed. 

The creation of some documents is strongly content - 
oriented (e.g., a legal brief) or strongly layout oriented 
(e.g., an advertisement). For other documents, the creation 

20 process is a hybrid effort combining both content-centric and 
layout -centric tasks. In a magazine page that contains an 
article next to an advertisement, for example, the content 
may be the focus in creating the article while the layout may 
be the focus in creating the advertisement. 

25 Summary 

In general, in one aspect, the invention features 
enabling storage of bindings that describe a document by 
associating content elements with layout elements, the layout 
elements defining layout features or placement information to 

30 be applied to the associated content elements in the 
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document, the bindings being stored separately from both the 
content and layout elements. 

Implementations may include one or more of the 
following features . 
5 Other stored bindings may describe another, different 

document by associating at least one of the content elements 
with at least one of the layout elements, at least one layout 
element defining layout features or placement information to 
be applied to at least one corresponding content element in 

10 the different document. The bindings for the different 
document may be stored separately from the bindings for the 
document and separately from the content and layout elements. 

We use the term "documents" in a broad sense to 
include not only human readable documents but' also a wide 

is variety of other kinds of presentations, including audio and 
video productions, multimedia, graphics, and synthesized 
speech (in which, for example, the words comprise the 
"content" and the intonation the "layout"). The term 
"document" also includes sets of information that relate to 

20 documents, such as job tickets, database tables that define 
documents, tables of contents, indexes, and summaries. 

Implementations of the invention may include one or 
more of the following features. The bindings may provide a 
primary control for the generation of the document and the 

25 different document. The document and the different document 
are generated using the elements and bindings. At least some 
of the layout elements and at least some of the content 
elements are identified by uniquely named binding sites. The 
content elements and the layout elements are stored 

30 separately in portfolios. Some of the bindings are layout- 
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centric and some of the bindings are content - centric . In 
some case the bindings for the document and the different 
document may be the same and at least one of the content 
elements and layout elements associated with the binding 
5 sites may be different for the document and the different 
document. Or the bindings may be different and at least some 
of the content elements and the layout elements are the same. 

In general, in another aspect of the invention, an 
application program is used to create content elements (or 

10 layout elements) for use in documents. The content elements 
(layout elements) are stored in a format native to the 
application program. Based on the stored content elements 
(layout elements) a content portfolio (layout portfolio) is 
formed by storing unique binding site names associated with 

15 respective content elements (layout elements) and information 
that aids a formatter in* generating documents based on the 
content elements (layout elements) and on layout elements 
(content elements) stored in a layout portfolio (content 
portfolio) . 

20 Implementations of the invention may include one or 

more of the following features. The information that aids 
the v formatter includes attributes ,, associated with the content 
elements. The content portfolio (layout portfolio) includes 
implementation specific properties and portfolio-specific 

25 attributes . A binding specification, which refers to the 
content elements, is also stored. The content portfolio 
(layout portfolio) also includes a list of binding sites of 
elements belonging to the content; portfolio (layout 
portfolio) and a list of groups of content elements (layout 

30 elements) belonging to the content portfolio (layout 
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portfolio) . 

In general, in another aspect of the invention, a 
binding specification is created for use in formatting 
documents based on the binding specification, content 
5 elements referenced by the binding specification, and layout 
elements referenced by the binding specification. The 
binding specification includes composition sequences that aid 
the formatter in formatting documents, the composition 
sequences defining the order in which formatting is to 
10 proceed using bindings between content elements and layout 
elements. The binding specification stores global bindings 
and direct bindings that aid the formatter in formatting 
documents . 

Implementations of the invention may include one or 
15 more of the following features. The global bindings may 
include a list of element bindings that define a default 
binding for elements of a specified type. The global 
bindings include a list of model bindings that define a 
default model for a specified binding site. The binding 
20 specif ication contains composition sequences that aid the 
formatter in formatting documents, the composition sequences 
defining the order in which formatting is to proceed using 
bindings between content elements and layout elements. Each 
of the composition sequences includes composition blocks 
25 containing ordered lists of direct bindings. Each of the 
direct bindings comprises a placement binding or a style 
binding . 

The invention also includes a medium storing a 
content portfolio or a layout portfolio or a binding 
30 specification. 
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In general, in another aspect, the invention features 
processing binding elements that comprise placement bindings 
before binding elements that comprise style bindings. 

In general, in another aspect, the invention features 
5 determining whether the layout should be dominated by the 
layout components or the layout aspects of the content 
components . 

Among the advantages of the invention are one or more 
of the following. The invention enables document design that 
10 efficiently handles both content-centric and layout-centric 
composition. Content elements and layout elements may be 
reused. Different application file formats may be 

accommodated. 

Other advantages and features will become apparent 
15 from the following description and from the claims. 

Description of the Drawings 
Figure 1 is a block diagram of a system for machine 
generation of human readable documents. 

Figure 2 is a block diagram of a content portfolio. 
20 Figure 3 is a block diagram of a layout portfolio. 

Figure 4 is a block diagram of a binding 
specification. 

Figures 5A and 5B illustrate a layout portfolio. 
Figures 6A and 6B illustrate a document based on the 

2 5 layout portfolio. 

Description of the Preferred Embodiments 
As seen in figure 1, in a system 10 for computer 
generation of human readable documents, information about the 
content of a document 12 to be printed or displayed, and 

3 0 information about the layout of the document, are stored 
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separately. For example, they could be stored in separate 
files called a layout portfolio 14 and a content portfolio 
16. The portfolios are generated by a user 17 interacting 
with, respectively, a layout application 18 and a content 
5 appl icat ion 2 0 . 

"Content" includes text, images, figures, tables, and 
layout information that is intrinsic to the content (such as 
the order of words in a paragraph) . "Layout" includes fonts, 
paragraph styles, page layout, formatting, kerning, and 

10 placement, and content that is intrinsic to the layout 
information. An example of content that is intrinsic to 
layout would be text used for decoration, for which the 
shapes of the letters are more important than what the words 
spell. Another example is a graphic used as a border or 

15 frame around a page . 

The content application may be an existing word 
processor or illustration program or any other application 
that is used to generate content for documents. The layout 
application could be an existing page layout program or any 

20 other application that is used to generate layouts for 
documents. Alternatively, the layout and content 

applications could be written for the specific purpose of 
creating content and layout portfolios. The layout and 
content applications could be combined as a single 

25 application and the layout and content portfolios could be 
parts of a single stored file provided that the elements of 
the portfolios are separately accessible in a manner 
described later. 

The information stored in the content portfolio does 

30 not need to describe the relationship of that information to 
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the information stored in the layout portfolio nor vice 
versa. Rather, the interrelationship of the content and 
layout information is defined by a stored binding 
specification 22. The binding specification is generated by 
sa user interacting with a binding application 26. 

Just as a user authors a content portfolio 16 using a 
content application 2 0 and authors a layout portfolio 14 
using a layout application 18 , the user also authors a 
binding specification 22 using a binding application 26. 

10 While working with the binding application, the user is able 
to identify content elements and layout elements and to 
specify the interrelationships between them. 

As will be explained in more detail below, the 
binding specification contains a list of binding operations. 

is Each binding operation refers to one or more content 
elements stored in the content portfolio and to one or more 
layout elements stored in the layout portfolio and specifies 
an operation that relates the content to the layout. The 
references are made by identifying binding sites associated 

20 with the respective layout and content elements. Each 
element of content (e.g., a paragraph of text) or layout 
(e.g., a style sheet) is identified by a binding site that is 
essentially a unique identifier or name. 

The content elements and layout elements required by 

25 a binding specification may be contained in more than one 
portfolio if the binding site names can be uniquely addressed 
by the binding specification. 

The information contained in the content portfolio 
may be stored in a file format that is typical of the file 

30 format of the application used to generate it. Similarly, 
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the information contained in the layout portfolio may be 
stored in a file format that is typical of the file format of 
the application used to generate it. In these cases, 
software APIs are used to present the application file format 
5 data as standard portfolio data to formatting and binding 
applications . 

Once a binding specification has been created for a 
document and the layout and content elements named in it are 
available in content and layout portfolios, one or more 

10 documents (identical or different) can be generated for an 
output device 28 such as a printer, a monitor, or a video 
storage element. The documents are generated by a formatter 
30 that processes the binding operations of the binding 
specification using the stored content and layout elements 

15 cited in the binding operations. 

The interaction of the formatter 3 0 with the layout 
and content portfolios and the binding specification occur 
through application programming interfaces (APIs) 40, 42, 44 
for the layout portfolio, content portfolio, and binding 

20 specif ication. The purpose of the APIs is to enable a single 
formatter to use a common protocol to handle possibly 
different formats of the layout portfolio, the content 
portfolio, and the binding specification. 

The output of the formatter is a data stream 

25 appropriate to drive the printer, monitor, or other output 
device . 

The binding specification contains information that 
tells the formatter how to resolve conflicts between layout 
features that may be present in content elements and content 
30 features that may be present in layout elements. As an 
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example of a layout feature present in a content element, and 
how it may be resolved, suppose an image box is 2" x 2" and 
the content bound to that layout element by the binding 
specification is 3" x 3 M . The binding specification can 
5 specify that the size dictated by the layout element should 
take precedence, and the content changed (scaled down) 
accordingly. 

Because content elements are handled independently of 
layout elements and because a separate binding specification 

io is used to define the relationships between layout elements 
and content elements, a user may create content without 
paying much attention to the layout that may use it. 
Similarly, the user may create a layout without much concern 
for the content that is to fill it. Furthermore this 

is independent authoring can be handled differently for 
different portions of a given document. 

The binding specification operations include 
placement directives that indicate where content is to be 
placed and style directives that tell how content is to 

20 appear. Because the binding specification can draw from 
independently available content and layout elements, the 
specification can be partially layout -centric and partially 
content -centric under the control of the user who generates 
the binding specification. Consequently, the user can 

25 generate documents that have both content-centric and layout- 
centric portions. 

A single binding specification can be used to create 
more than one different document by simply changing one or 
more of the content or layout elements that are associated 

30 with the binding sites named in the specification. In that 
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sense, the binding specification defines a logical document 
rather than an actual document with the actual content and 
layout determined by the underlying material that is referred 
to by the binding site names. Furthermore, different 
5 documents can be created from a given binding specification 
by substituting different entire portfolios of layout and 
content provided that the content and layout elements that 
they contain have the binding site names referred to in the 
binding specification. 

10 Also, content and layout elements can be used to 

generate different documents by creating different binding 
specifications that refer to those same elements. 

The same layout elements can be bound in a single 
way, represented by a single binding specification, to create 

15 different documents based on different contents. The same 
content can be bound in different ways to different layout 
elements using different bindings to create different 
documents. And the same content can be bound to many 
different layouts using a single binding. 

20 Content and layout elements have a recursive 

structure as do binding sites and binding operations. 
Generally, a content portfolio cannot refer to a layout 
portfolio or vice versa. Content portfolios may have 
internal links to other content portfolios and layout 

25 portfolios may have internal links to other layout 
portfolios . 
Content portfolio 

As shown in figure 2, the content of a content 
portfolio 97 is expressed in a tree of portfolio element 

30 objects beginning at a root element called Root portfolio 
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(PF) element 80. Examples of the tree elements include the 
texts of articles 82, 84, sections of the articles 86 and 
paragraphs of sections 88. A paragraph element 88 could 
contain attribute information 90 (e.g., the fact that the 
slanguage of the text is French), a nickname 92, and content 
information 94, such as the sentence "Mary had a little 
lamb." The content information could be further specified as 
a list 95 of sub-content element pointers, 97, 99, which 
point to pieces of the content of a paragraph element. The 

io purpose of the nickname is to allow users to optionally 
include an informal description of a portfolio element. This 
can help at binding time. When confronted with an element 
name such as "mi38798-2383 " , a human might find it convenient 
to have an informal description to understand what the 

is element is, so that a correct binding can be made, for 
example, "A line from a nursery rhyme". 

The portfolio includes a list 100 of binding sites 
102 each of which contains a pointer that associates the 
binding site with one of the elements in the tree. In the 

20 example, a site could point to an article, a paragraph, an 
item of subcontent, or to a group of elements. 

As seen in figure 2, a list of groups 110 can be 
provided. Each group defines a group of binding sites of 
content elements that may go together. Groups allow 

25 collections of elements to be formed regardless of their 
positions in the hierarchical structure of the portfolio. 
For example, suppose Articlel contains a heading and three 
paragraphs while Article2 contains a heading and four 
paragraphs. In a table of contents, the headings may be 

30 listed using a single reference by forming a group of the 
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binding sites for the headings in Articlel and Article2 . 

The content portfolio also stores implementation- 
specific properties 111 that are pertinent to a class or kind 
of portfolio rather to an individual specific portfolio. For 
5 example, portfolios of a particular kind may have a maximum 
nickname length of 16 characters and a maximum length for 
names of attributes of 32 characters. The content portfolio 
also stores portfolio specific attributes 113 that are 
peculiar to a given portfolio. An attribute may be whether 

10 the "source" is embedded (yes or no). "Embedded source = 
yes" means the data for the content elements is included in 
the same file as the portfolio data. "Embedded source = no" 
means the content data is located elsewhere and is referred 
to by reference from the portfolio data. Another attribute 

15 may be whether restrictions are stored (yes or no). A list 
of referers 115 contains a list of the globally unique IDs of 
every object (such as a binding specification) that refers to 
this portfolio. Here and elsewhere, globally unique means 
unique within the scope specified in a given implementation. 

20 Each content element is characterized by an attribute (for 
example, whether there is an external reference or whether 
the element is in AllOneLanguage) , a nickname (such as 
"Hamlet's Query"), and the content of the element, such as 
the text "To be or not to be?" 

25 Figure 2 illustrates the logical structure of the 

content portfolio. The actual data structures and file 
formats could vary. The data structures and logical 
organization should be used consistently in all of the 
portfolios. A similar logical structure is used for layout 

30 portfolios as described below. 
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The content application must be able to create a 
hierarchy of content elements of the kind suggested in figure 
2, the list of sites, and the list of groups based on 



5 content application, such as a word processor, is used, the 
tree, list of sites, list of groups, implementation-specific 
properties, portfolio-specific attributes, and list of 
referers are created by including the additional data in the 
existing application file format. This is achieved with 
10 software that implements the API mentioned earlier. The API 
can implement exactly the list of required data structures 
and operations (such as getting and setting properties and 
attributes) implied by those structures. 



15 set forth below as an XML document consisting of articles, 

headings, sections, paragraphs, and image references. Some 

of these have binding sites that are referenced in the 
binding specification that is set forth below. The binding 

site identifiers appear after the letters BS in certain 

20 sections of the portfolio. 
<BASICCONTENT> 



information provided by the user. 



When a conventional 



An example of a content portfolio for a brochure is 



<RIDS> 



<RJD RIDINDEX="2" VAL="ImgApp7> 



<RID RIDINDEX="1 U VAL="85DE1C45-2C66-101B-B02E-04021C0094027> 



25 



</RIDS> 



<GROUPS> 



<GROUP> 



<BS RIDINDEX— '1" UID= M ItemHeads7> 



<MEMBER RIDINDEX- T 1 UID= M IID107> 



30 



<MEMBER RIDINDEX-' 1" UID= M IID1 17> 
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<MEMBER RIDINDEX-T' UID= n IID127> 



<MEMBER RIDINDEX-'i" UID="IID137> 



<MEMBER R1DINDEX=" 1 " UID="IID 147> 



<MEMBER RIDINDEX- ' 1 " UID="IID 1 5 7> 



'sir 




</GROUP> 
</GROUPS> 
<DOCATTRS/> 
<FlowTxtCModel.ARTICLE> 
<BS RIDINDEX= ,, 1 M UID= n FiberSaverBrochure"/> 
<FlowTxtCModei.HEADING> 
<BS RIDINDEX="1" UID="Heading7> 
<TxtCModel.TEXT>PlanetSaver International Products<SS 

RIDINDEX-T' UTO^'SMLl" BEGIN="13" END- '26' 

HINT= n International7> 

</TxtCModel.TEXT> 
</FlowTxtCModel.HEADING> 
<FlowTxtCModel.SECTION> 

<BS RIDINDEX-T' UTO='TiberSaverOverview7> 

<FlowTxtCModel.PARA> 



<TxtCModel.TEXT>Somebackground:</TxtCModel.TEXT> 
</FlowTxtCModel.PARA> 
<FlowTxtCModel.PARA> 



<TxtCModel.TEXT>Understanding the limitations of man-made products, we set 
out to develop products that were made strictly from the four basic elements. After years of development, 
we did just that. PlanetSaver items are 95% earth, air, fire, and water - the stuff of legends and of good 
environmental policies. </TxtCModel.TEXT> 



<TxtCModel.TEXT>Our products not only perform to the most exacting 
specifications, they do so without harming the planet which we, and lots of other furry creatures, call 



</FlowTxtCModel.PARA> 



<FlowTxtCModel.PARA> 
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home. This lets you have the products you want, a clear conscience, and clean planet all at the same time. 
We call this progress in the truest sense.<VTxtCModeLTEXT> 

</FlowTxtCModel.PARA> 

<FlowTxtCModeLPARA> 

5 <TxtCModel.TEXT>With our items on the market we are that much closer to 

preserving our precious resources. </TxtCModel.TEXT> 
</FlowTxtCModel.PARA> 
</FlowTxtCModel.SECTION> 
<FlowTxtCModel.SECTION> 
1 0 <BS RIDINDEX-' 1 " UID="MainBody7> 

<FlowTxtCModel.PARA> 

<TxtCModel.TEXT>PlanetSaver International is the company for 
environmentally-minded people who are also budget-minded. Our products are made from all natural 

\** source like earth, wind, fire, and air. That's right - every PlanetSaver product you buy is made from the 

Ms? 

.3% 15 stuff of ancient Greek mythology. There's not one thing in our products that has a multisyllabic name. 
; |I Only the most pure dirt, the swiftest wind, the hottest fire, and the cleanest air. Ingredients any consumer 

[ \ % can be proud of.</TxtCModel.TEXT> 

: 1 1 </FlowTxtCModel.PARA> 
\ 1 { <FlowTxtCModel.PARA> 

.1% 2 0 <TxtCModel.TEXT>PlanetSaver doesn't just make products a mother would be 

proud of, we make products that mother earth would enjoy. Take our dirt-based soap products. Rather 
than try to wash away dirt with harsh chemicals, PlanetSaver's Blendln AntiSoap is just more pure dirt 
that will make those dirty spots on your clothes just fade into the background. We don't fight against 
nature, we work with it for 

2 5 you.</TxtCModel.TEXT> 

</FlowTxtCModel.PARA> 

<FlowTxtCModel.PARA> 

<TxtCModel.TEXT>What's more, PlanetSaver International 
doesn't just make products for the home, we make products for 

3 0 the home office right up to the insensitive corporate 
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behemoth.</TxtCModel.TEXT> 

</FlowTxtCModel.PARA> 

<FlowTxtCModel.PARA> 

<TxtCModel.TEXT>Our products distinguish themselves in so 
5 many ways from those of our competitors. For example, take 

our manufacturing processes. Our Blendln AntiSoap is made by 
trained environmentalists who gather dirt in an earth-safe 
way and caringly place it in recycled or reused cardboard 
boxes.</TxtCModel.TEXT> 
1 0 </FlowTxtCModel.PARA> 

<FlowTxtCModel.PARA> 

<TxtCModel.TEXT>And lets talk about being cruelty-free. At 
PlanetSaver International we never test our products on 
animals. We don't have to! The basic ingredients of our 
15 products are in use by animals all over the world every day. 

Take for example, dirt. Can you think of any animal that 
doesn't like dirt? I didn't think so. And what about air? 
Even fish like air and we've got it!</TxtCModel.TEXT> 

</FlowTxtCModel.PARA> 
2 0 <FlowTxtCModel.PARA> 

<TxtCModel.TEXT>Our products are a blend of good old mother 
nature and good old American ingenuity and marketing magic. 
You can feel good about yourself and the environment by using 
products made from little more than dirt, and at the same 

2 5 time you can support a great company like ours. It's a 

win- win- win situation. If you like at it in that light, 
you'll ask yourself why it's taken you so long to become a 
member of the PlanetSaver family. </TxtCModel.TEXT> 
</FlowTxtCModel.PARA> 

3 0 <FlowTxtCModel.PARA> 
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<TxtCModel.TEXT>We have so many great products that we can't 
list them all here. We can only scratch the surface. Some of 
our best- sellers include PlanetSaver InstaLight and 
PlanetSaver ThirstQuencher. InstaLight consists of a mircale 
5 of nature, fire, in a convenient, safe, portable and easy to 

use form. How is this possible you might 
ask?</TxtCModel.TEXT> 

</FlowTxtCModel.PARA> 

<FlowTxtCModel.PARA> 
1 0 ^xtCModel.TEX^Well, we provide a small container of 

natural, and we stress the word natural, gas along with a 
flint and stone striker system that lets you take fire 
anywhere you want to be. Some people think this is nothing 
more than a simple lighter - a product that's been around for 
15 decades. Well, technically it is, but now you can have piece 

of mind knowing that it comes from us. We make fire 
clean.</TxtCModel.TEXT> 

</FlowTxtCModel.PARA> 

<FlowTxtCModel.PARA> 

2 0 <TxtCModel.TEXT>That brings us back to one of our other favorite products. 

Our ThirstQuencher is more than just another bottle of water. It's a bottle of water from 

PlanetSaver so you know its pure. You can feel safe pouring it down a sewer grate 
because you know that is where it came from to begin with - the Earth. We don't even filter it - if it's good 
enough for the other animals it's OK by us.</TxtCModel.TEXT> 

2 5 </FlowTxtCModel.PARA> 

<FlowTxtCModel.PARA> 

<TxtCModel.TEXT>Visit your local PlanetSaver distributor to learn more about 
our exciting new line of PlanetSaver products. You won't be sorry you did.</TxtCModel.TEXT> 
</FlowTxtCModel.PARA> 

3 0 </FlowTxtCModel.SECTION> 
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<FlowTxtCModel.SECTION> 

<BS RIDINDEX-T' UTO=TiberSaverComparison7> 
<FlowTxtCModel.HEADING> 

<BS RIDINDEX='T' UID="IIDl"/> 
5 <TxtCModel.TEXT>How does Blendln stack up against other cleaning 

products?</TxtCModel.TEXT> 

</FlowTxtCModel.HEADING> 
<FlowTxtCModel.PARA> 

<BS RIDINDEX-'l" UID= n IID10 n /> 
1 0 <TxtCModelTEXT>Weight</TxtCModel.TEXT> 
</FlowTxtCModeLPARA> 
<FlowTxtCModeLPARA> 

<TxtCModel.TEXT>BlendIn is approximately 15% lighter than an equivalent 
soap product </TxtCModel.TEXT> 
1 5 </FlowTxtCModel.PARA> 
<FlowTxtCModel.PARA> 

<BS RIDINDEX-" 1 " UID= M IID 1 1 7> 
<TxtCModel.TEXT>Price<rxtCModeLTEXT> 
</FlowTxtCModel.PARA> 
2 0 <FlowTxtCModel.PARA> 

<TxtCModel.TEXT>In large quantities, Blendln is only 3-5% more expensive 
than soap.</TxtCModel.TEXT> 

</FlowTxtCModeLPARA> 
<FlowTxtCModel.PARA> 

2 5 <BS RIDINDEX=" 1 " UID-"IID12 M /> 

<TxtCModel.TEXT>Lifetime</TxtCModel.TEXT> 
</FlowTxtCModeLPARA> 
<FlowTxtCModel.PARA> 

<TxtCModel.TEXT>BlendIn will live as long as your clothes do. We guarantee 

3 0 it.</TxtCModel.TEXT> 
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</FlowTxtCModel.PARA> 
<FlowTxtCModel.PARA> 

<BS RIDINDEX='T* UID="IID137> 
<TxtCModelTEXT>Warranty</TxtCModel.TEXT> 
5 </FlowTxtCModel.PARA> 
<FlowTxtCModel.PARA> 

<TxtCModel.TEXT>We warranty Blendln for the life of your clothes. You can't 
go wrong.</TxtCModel.TEXT> 

</FlowTxtCModel.PARA> 
1 0 <FlowTxtCModel.PARA> 

<BS RIDINDEX= n 1 " UID= n IID147> 

<TxtCModel.TEXT>Environmental Impact<TxtCModel.TEXT> 
</FlowTxtCModel.PARA> 
<FlowTxtCModel.PARA> 

15 <TxtCModel.TEXT>BlendIn uses reclaimed materials from other manufacturing 

processes. It is a very low impact 

product.</TxtCModel.TEXT> 
</FlowTxtCModel.PARA> 
<FlowTxtCModel.PARA> 
20 <BS RIDINDEX="1 M UID="IID157> 

<TxtCModel.TEXT>Customization</TxtCModel.TEXT> 
</FlowTxtCModel.PARA> 
<FlowTxtCModel.PARA> 

<TxtCModel.TEXT>With thousands of choices, Blendln is as unique as you 

2 5 are.</TxtCModeLTEXT> 

</FlowTxtCModel.PARA> 
</FlowTxtCModel.SECTION> 
<FlowTxtCModel.SECTION> 

<BS RIDINDEX-'l" UID^'-Details"^ 

3 0 <FlowTxtCModel.PARA> 
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<TxtCModel.TEXT>We at PlanetSaver do our utmost to make not only 
outstanding products that we can stand behind, but we also strive to give you the information you need to 
make an informed choice. You can get more information directly from our website, 
www.treehuggers.xyz, or by visiting a PlanetSaver distributor in your area.</TxtCModel.TEXT> 
5 </FlowTxtCModel.PARA> 
<FlowTxtCModeLPARA> 

<TxtCModel.TEXT>While we do our best to be completely accurate at all times, 
we can not be held resposnible for typographical errors here, or in our website. To confirm any 
information about our products, call us directly at 1 (800) 555-DIRT.</TxtCModel.TEXT> 
1 0 </FlowTxtCModel.PARA> 
</FlowTxtCModeLSECTION> 
</FlowTxtCModel.ARTICLE> 
<Model.REFERENCE UID= M Wilderness" 
PORTFOLIO_REF=Tile:///D:/DEV/TestCases/Demo/Brochure/ImagesAVildemessW 
15 RID-"Brochure M > 

<BS RID INDEX—' 1 " UnD="WildPlace7> 
</Model.REFERENCE> 
<RasterGfxCModel.RASTER 
REF="file://D:/DEV/TestCase^ 
2 0 RIDINDEX-' 1 " UID= n CornerImgLeft'7> 
</RasterGfxCModeLRASTER> 
<RasterGfxCModel.RASTER 
REF=Tile://D:/DEV/TestCases/Demo/Broch^ 
RIDINDEX-' 1" UID= M CornerImgRight7> 
2 5 </RasterGfxCModel.RASTER> 
</BASICCONTENT> 

Even though a number of images are referenced at the 
end of the content, they appear in various places in the 
30 formatted output, not only at the end. The binding 
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specification pulls them out (based on their binding sites) 
and places them explicitly. 
Layout portfolio 

As seen in figure 3, the layout portfolio 302 includes 
5a list of groups 110 and a list of binding sites 100 that are 
like the ones in the content portfolio. The information in 
the layout portfolio is expressed, as in the content 
portfolio, as a tree of portfolio elements beginning at a 
Root portfolio (PF) element 304. As in the case of the 

10 content portfolio, the entire tree is accessible through the 
root element. As shown, some elements are also the targets 
of pointers in binding sites. Examples of layout elements 
include paragraph styles 306, font styles 3 08, text flows 
310, and master pages 312. 

15 Layout portfolios also contain implementation-specific 

properties 111, portfolio-specific attributes 113, and a list 
of referers 115, that are similar to the ones in the content 
portfolios discussed above. For example, the implementation- 
specific properties may specify which version of the layout 

20 application was used to generate this layout portfolio, and 
the portfolio-specific attributes may specify where font 
files are located. 

The layout application must be able to create a 
hierarchy of layout elements of the kind suggested in figure 

25 3, the list of sites, and the list of groups based on 
information provided by the user. When a conventional layout 
application, such as a page layout program, is used, the 
tree, list of sites, list of groups, implementation-specific 
properties, portfolio-specific attributes, and list of 

30 referers are created by including the additional data in the 
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existing application file format. This is achieved with 
software that implements the APIs mentioned earlier. The 
APIs may implement exactly the list of required data 
structures and operations (such as getting and setting 
5 properties and attributes) implied by those structures. 

An example of a layout portfolio (for the brochure 
associated with the content portfolio set forth above and the 
binding specification set forth below) is shown in figures 5A 
and 5B. The brochure covers a two-page spread. An 

10 alternative layout portfolio could arrange the brochure onto 
one portrait page. This layout portfolio is shown as it 
would appear on screen and is based on the FrameMaker7 file 
format, although other file formats could be used. The 
outlined areas are specifications of the layout geometry. 

15 Within the layout portfolio, the style specifications, like 
paragraph and character styles, are carried in standard 
FrameMaker style elements. All of the geometry and style 
elements are referenced in an index section. This index 
describes the binding sites that are visible to the clients 

20 (e.g., the formatter) and how they relate to internal 
FrameMaker elements. The index for the layout portfolio is 
set forth below. Each of the elements in the index assigns a 
binding site and in some cases additional parameters to an 
internal FrameMaker object like a Frame (which provides 

25 geometry information) or a style (which says how something 
should look- -e.g., the font to use). 
<FRAMELAYOUT> 
<RIDS> 

<RID RIDINDEX-'T' VAL= n 85DElC45-2C66-101B-B02E-04021C009402 H /> 

3 0 </RIDS> 
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<ELEMENT IID="ParaStyle.SmallBody n > 

<BS RIDINDEX-'l" UID= M SmallBody n /> 
</ELEMENT> 

<ELEMENT HD="ParaStyle.Body" > 
5 <BS RIDINDEX-' 1 " UID=*'Body 7> 

</ELEMENT> 

<ELEMENT IID= M ParaStyle.HeadingRunIn M > 

<BS RIDINDEX-'l" UID="HeadingRunIn'7></ELEMENT> 
<ELEMENT IID="ParaStyle.Headingl "> 
1 0 <BS RID INDEX- ' 1 " UID="Heading 1 ' 7> 

Q </ELEMENT> 
*M <ELEMENT HD="ParaStyle.Title"> 

|j5 <BSRIDINDEX="l"UID="Title"/> 
!?} </ELEMENT> 
!i( 15 <ELEMENT IID="CharStyle.l8pt"> 

«|J <BS RIDINDEX-'l" UID="18pt7> 

!U </ELEMENT> 
^| <ELEMENT HD="CharStyle.SmailCaps"> 

<BS RIDINDEX-' 1 " Un>"SmallCaps7> 
2 0 <ELEMENT> 

<ELEMENT IID="AnchorStyle.RunIn"> 

<BS RIDINDEX-' 1 " UID="AFRunIn7> 
</ELEMENT> 

<ELEMENT IID="AnchorStyle. Inline "> 

2 5 <BS RIDINDEX=" 1 " UID= M AFInline7> 
</ELEMENT> 

<ELEMENT IID= n Flow. Sidebar l n > 

<BS RIDINDEX-'l" UID= n Sidebarl"/> 
</ELEMENT> 

3 0 <ELEMENT IID="Flow.Sidebar2"> 
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<BS RIDINDEX='T' Uro=*'Sidebar27> 
</ELEMENT> 

<ELEMENT IID= ,, FIow.Main n > 

<BS RIDINDEX='T* UID="Main7> 
5 </ELEMENT> 

<ELEMENT HD="Flow.FinePrinf '> 

<BS RIDINDEX-'T* UID= M FinePrint7> 
</ELEMENT> 

<ELEMENT IID="Flow.Heading"> 
10 <BS RIDINDEX= H l n Un>"Heading7> 

</ELEMENT> 

<ELEMENT IID= n GfxCont.HeadBackground" FIT="FitGraphicToFrame"> 

<BS RIDINDEX—' 1 " UID= u HeadBackground"/> 
</ELEMENT> 

1 5 <ELEMENT IID-"GfxCont.Imagel " FIT="FitGraphicToFrame M > 

<BS RIDINDEX= n l M UID="Imagel n /X/ELEMENT> 
<ELEMENT IID= H GfxCont.Image2" FIT= n FitGraphicToFrame"> 

<BS RIDINDEX- M r' UID-"Image2"/> 
</ELEMENT> 
2 0 </FRAMELAYOUT> 

Binding specification 

As seen in figure 4 7 a binding specification 200 
contains associations between binding sites in a content 
25 portfolio and binding sites in a layout portfolio. The main 
components of a binding specification are a list of element 
bindings 199, a list of model bindings 201, a referer ID 202, 
and a list of composition sequences 210. 

The referer ID 202 is a globally unique ID of the 
30 binding specification. When the formatter is to look up a 
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site in a content or layout portfolio, the formatter uses the 
ID of the portfolio. 

The list of model bindings contains model bindings, 
each of which restricts a site to a given content or layout 
5 model, thus guaranteeing that a certain type of data will be 
found at the site. Using the API, the formatter can ask the 
portfolio what the model of a specified element is. If the 
model does not match what the model binding says, the 
formatter can display an error message to the user. For 

10 example, a model binding could provide that sites 12, 34, and 
387 in a layout portfolio must be FontStyles. The model 
binding also specifies whether the site is in a content or 
layout portfolio. 

The list of element bindings contains element bindings 

15 each of which maps content elements of a given type to one or 
more layout elements, styles in particular. For example, an 
element binding could map all content elements of the type 
PARAGRAPH to a layout element representing a particular 
paragraph style . 

20 A binding specification contains an ordered list of 

composition sequences 212. Each composition sequence 

contains an ordered list of composition blocks 214. Each 
composition block contains an ordered list of bindings 216. 

A direct binding 216 associates one or more sites of 

25 source elements with one or more sites of destination 
elements. For example, the binding could list source sites 
(10, 9123, and 45) and destination sites (6719, 893, and 
6594) . The source elements could be content elements and the 
destination elements could be a layout elements or vice 

30 versa. For example, a direct binding could indicate "place 
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this content element (a picture) in this layout element (an 
image frame) " . 

There are two types of direct bindings: placement 
bindings and style bindings. Placement bindings "place" one 
5 or more content elements into one or more layout elements, 
such as placing text on a page. Style bindings assign one or 
more styles either to one or more content elements (font 
styles to text) , or to one or more layout elements (new 
paragraph styles for page 3 and 4) . 

10 A template 220 associates a type of layout container 

(e.g., a specific master page of a layout portfolio) with 
information about when the container should be used (e.g., 
for first pages that appear on the right side of two page 
spreads) . The syntax may be "Site (always in Layout) : 6719; 

15 Usages: (FIRST, RIGHT)" 

One implementation may store the binding specification 
structures in XML format but other formats could also be 
used. 

An example of a binding specification follows: 

2 0 <BindSpec> 

<Header> 

<Title>Example Binding Specification</Title> 
<RID>85DE 1 C45-2C66- 1 0 1 B-B02E-0402 1 C009402</RID> 
<Header> 
25 <Global> 

<Elem name=TlowTxtCModel.PARA" > 
<Site uid="Body7> 

</Elem> 
</Global> 

3 0 <Direct> 



- 28 - 



<Compose> 

<Block> 

<Place src="WildPlace" dst= M HeadBackground7> 
<Place src= M CornerImgLeft" dst="Imagel" required="no7> 
5 <Place src="ComerImgRight" dst="Image27> 

<Place src="Heading n dst="Heading7> 
<Place src= M FiberSaverOverview M dst="Sidebarl7> 
<Place src- TiberSaverComparison" dst="Sidebar27> 
<Place src^'MainBody" dst="Main7> 
1 0 <Place src- 'Details" dst="FinePrint M /> 

<Style dst="Heading" src='Title7> 
<Style dst="SMLl" src="18pt7> 
<Style dst= n Details" src- M SmallBody7> 
<Style dst="IIDr src="Headingl7> 
1 5 <Style dst="ItemHeads" src= M HeadingRunIn , 7> 

</Block> 
<Templates> 
</Templates> 
</Compose> 
20 <Direct> 

</BindSpec> 

Most of the specification lists placements and style 
applications. The place elements describe where content 

25 elements should go. The style elements describe how the 
content should look. The global element specifies that all 
elements in the content whose Model is "FlowTxtCModel . PARA" 
should have the style "Body" applied to them. In other 
words, all paragraphs should use the Body style unless 

30 explicitly overridden by a more specific binding. 
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This binding specification is layout -oriented . It 
takes content and content elements and places them in 
predefined layout locations. Binding specifications can also 
be content -oriented or a mixture of both. A content -oriented 
5 binding specification would not specify the placement of each 
content element. Instead it would "pour" the content into 
layout templates that would grow as necessary (e.g. adding 
new pages) to accommodate the content. 
Operation of formatter 

10 The formatter generates document pages by processing 

the binding specification. The formatter first extracts and 
stores any global bindings for later reference. These 
bindings only provide style information. The formatter then 
process the binding specification a composition sequence at a 

15 time in the order in which they appear in the binding 
specification. For each composition sequence, the formatter 
retrieves all contained composition blocks. If a given 
composition sequence contains more than one composition block 
with a placement binding, then those placements are processed 

20 in parallel. For example, a single composition sequence 
might contain two composition blocks each of which places an 
article in a separate column on the same page. 

Within a composition block, all placement bindings are 
processed before any style bindings are processed. Placement 

25 bindings are processed in the order in which they appear in 
the block. A placement binding can either refer to a fixed 
layout element, like a text frame in a particular location on 
a particular page, or a location in a template (e.g. master 
page) . In the former case, the content element is poured 

30 into the fixed container. New pages will not be added to 
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accommodate the content. The content must fit in the 
container provided. In the latter case, a new page is 
created based on the template given in the binding 
specification and the content flows into the given container 
son the new page. Pages are added as necessary to accommodate 
the content. 

After the placements are complete, the style bindings 
are applied to the content that was just placed. The style 
bindings of a given composition block can be processed in any 

10 order with the exception of styles applied to subcontent . 
Since subcontent ranges can overlap, the order in which these 
styles are applied is important. For example, a paragraph 
might contain the words "Mary had a little lamb" . One 
subcontent element might refer to the words "had a little" 

lswhile another refers to the words "little lamb". When styles 
are applied to these overlapping areas (e.g. 'make "had a 
little" blue' and 'make "little lamb" red'), the order of 
application is given in the binding spec and adhered to by 
the formatter. 

20 In some situations, several style bindings of the same 

type might be applied to a single piece of content. The 
formatter must determine which of these styles is most 
closely bound to the content and apply that one. For example, 
a given paragraph might have a paragraph format , PI , bound to 

25 it directly. It may also have a different paragraph format, 
P2, indirectly bound to it by virtue of being part of a 
container that had P2 bound to it (e.g. the paragraph is part 
of a section that had P2 bound to it) . It may also have 
another paragraph style, P3 , bound to it with a global 

3 0 binding. The formatter maintains enough context to always be 
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able to determine the closest binding. 

Whenever the formatter processes a placement binding, 
it must examine the content object being placed, C, and 
determine whether there are placement bindings that refer to 
5 any of C's children. For example, a placement binding might 
tell the formatter to put a given article into a particular 
layout element (like a text box) and another placement 
binding in the same composition block might tell the 
formatter to put a particular paragraph, P, of C into a side 

lobar text block. The formatter must recognize these 
situations and remove P from C while C is being placed. It 
places P when it gets around to processing the placement 
binding that refers to it. This is also true for explicitly 
placed subcontent as well. 

15 A given piece of content can be placed both as part of 

it's parent and on its own by specifying placement bindings 
in different composition blocks. 

Figures 6A and 6B show the output of the formatter 
using the binding specification and content and layout 

20 portfolio examples given above. In the upper right corner of 
figure 6A, a graphic was pulled into the background and a 
heading was laid over it . 
APIs 

Each of the elements in the content and layout 
25 portfolios may comply with a native format that is peculiar 
to the application that generated it and that is different 
from the native format of other layout and content 
applications. For each of the applications, the API of 
figure 1 enables the formatter to make use of the content and 
30 layout elements and the binding specification. Among the 
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methods that may be implemented by each API are 

setting binding sites on content or layout elements, 
getting binding sites on content or layout elements, 
maintaining referential integrity of binding sites, 
5 instantiating a binding, 

enumerating the binding operations in a binding 
specification, 

editing content or layout elements or binding 
specifications, 
10 composing a document from a binding specification. 

Content models 

In one implementation, the content in content elements 
that are included in a content portfolio must all comply with 
predefined content models. In one scheme, all content 
15 elements must be one of the following: 
Text 

Flow Text 
Placed Text 
Graphic 
20 Layered Graphic 

Multi-model Graphic (preview vs. artwork) 
Raster Graphic 
Vector Graphic 
3D Graphic 
25 Dynamic Media (2D Animation) 

Video (also Layered Graphic and Raster Graphic) 
Audio (also Layered Graphic and Raster Graphic) 
These models form a class hierarchy, with multiple 
inheritance. Each subclass is allowed to add more expression 
30 (more features) to the super-class, but must at least provide 



the same features as the super-class. An example of sub- 
classing might be Footnote Flow Text as a sub-class of Flow 
Text. Content elements may use any internal structure and 
representation, as long as that format can be mapped to one 
5 of the content model classes or subclasses. 

The class hierarchy defines the scope of expression and 
constraints that apply to all elements. The base classes are 
predefined. New features can be defined by sub-classing. 
New base classes can be added although older formatters will 
10 not able to handle the new base classes until the formatters 
are upgraded. 

For example, if a content creator wishes to express 
traditionally structured text (sections, paragraphs, quotes) , 
he uses the flow text model or a subclass of it. If the 

15 content creator wishes to express multi-layered 2D graphics, 
he uses the layered graphic model. The content element 
implementation for a specific content native format (e.g., a 
text string in Microsoft Word file format) is mapped from the 
native format ' s model to one or more of the prescribed 

20 models, sub-classing as needed. 

Elements may implement more than one model at a time. 
For example, a content element of a native Adobe Illustrator7 
file may express itself as a vector or layered graphic or 
placed text. This content element may be easily used by a 

25 formatter that is designed to produce HTML output by treating 
the element as a Graphic super-class. The same element may 
be used by a formatter designed to generate FrameMaker files 
for printing by treating it as either a Graphic or Placed 
Text. The same element may be used by a full text indexer by 

30 treating it as Placed Text. 





Layout models 

The same principle is used with layout components 
although they are somewhat more difficult to model. 

The range of native layout representations is so large 
5 that effectively each native layout format defines its own 
model. Although the abstraction can be expressed at a higher 
level where there is universal commonality, doing so reduces 
the expressiveness of the layout elements to least -common- 
denominator features. 
10 One arrangement of high level layout models includes: 



15 explicit placement directives (such as character by 
character adjustments, text on a curve) . 

Presentation describes basic presentation attributes 
(styles) for content, such as font, color, and size. 

Dynamics describes how time or events affect the 

20 presentation, including animation, synchronization, triggers, 
and transitions. 

A layout element that does not implement the dynamics 
model has a static presentation in the sense that the 
document does not change over time. 

25 Each layout element implementation maps layout elements 

to corresponding content models. For example, the content 
flow text model needs placement, so a layout element maps 
appropriate placement containers to content flow texts (e.g., 
frames in FrameMaker) . The content Flow Text model needs 

3 0 presentation styles, so the layout presentation model maps 



Layout 

Presentation (styles) 
Dynamics 

Layout defines basic containers for contents and 
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appropriate styles to the content flow Texts (paragraph and 
character styles in FrameMaker) . The content Flow Text model 
also needs explicit placement information, so the layout 
model called layout maps appropriate placement information to 
5 content Flow Texts 
Clients 

Clients of the APIs (e.g., the formatter) take an 
active role while content and layout elements provide 
services to support the features of the clients. The content 
10 and layout elements do not implement features directly (for 
example, a content element does not implement " formatSelf " or 
"drawSelf " methods) . Clients ask elements for information as 
needed. 

The content and layout elements must provide 

15 information in accordance with the models they claim to 
implement. Clients rely on the component implementations to 
do any mapping necessary to supply the information. 

Other implementations are within the scope of the 
following claims. 

20 For example, an application could be provided that 

would enable a user to create new content to match aspects of 
an existing binding specification. 

Instead of providing a new special purpose formatter 
that would use the binding specification and content and 

25 layout elements to generate documents, it would be possible 
to use a formatter that already exists within another 
program, for example, the document formatter that is part of 
Microsoft Word. An new application would use the binding 
specification as the basis for driving the internal formatter 

30 to generate the documents. 
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Reference to class hierarchy description 

Appendix A contains a description of a class hierarchy 
for an implementation of the invention. 

What is claimed is: 
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